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Abstract. Many physical problems can be formulated as operator equations 
of the form Au = f. If these operator equations are ill-posed, we then resort 
to finding the approximate solutions numerically. Ill-posed problems can be 
found in the fields of mathematical analysis, mathematical physics, geophysics, 
medicine, tomography, technology and ecology. The theory of ill-posed prob- 
lems was developed in the 1960's by several mathematicians, mostly Soviet and 
Americaji. In this report we review the methods of solving ill-posed problems 
and recent developments in this field. We review the variational regulariza- 
tion method, the method of quasi-solution, iterative regularization method and 
the dynamical systems method. We focus mainly on the dynamical systems 
method as it is found that the dynamical systems method is more efficient 
than the regularization procedure. 
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CHAPTER 1 



What are ill-posed problems? 

1. Introduction 

Definition 1. A problem of solving an operator equation 
(1.1) Au^f 

where A : X — > Y is an operator from a Banach space X into a Banach space Y 
is called well-posed in the sense of J.Hadamard (1902) iff it satisfies the following 
conditions. 

(1) is solvable for any f Cz Y . (Existence of the solution, i.e., A is 
surjective.) 

(2) The solution to is unique. (A is infective.) 

(3) is stable with respect to small perturbations of f . (Continuous de- 
pendence of the solution i.e., A^^ is continuous.) 

If any of these conditions fails to hold, then problem il.l]) is called ill-posed. 

If the solution does not depend continuously on the data, then small errors, 
whether round off errors, or measurement errors, or perturbations caused by noise, 
can create large deviations in the solutions. Therefore the numerical treatment 
of ill-posed problems is a challenge. We shall briefly discuss below some of the 
concepts and auxiliary results used in this report. 

Henceforth D{A), R{A), and N{A) := {u : Au = 0} denote the domain, range 
and null-space of A respectively. Let A* : Y* — > X* be the adjoint operator. 
For simplicity we assume below that X — Y = H, where H is a. Hilbert space. 
If A is self-adjoint then A A* . If A is injective, then N{A) = {0}, A~^ is 
well-defined on R{A) and u = A^^f is the unique solution to equation (|l.ip for 
/ € R{A). Equation (|l.ll) is called normally solvable iff R{A) = R{A) i.e., iff 

f ± N{A*) = R{A)^. The overbar denotes closure. If N{A) ^ {0} define the 
normal solution (pseudo-solution) uq to equation (|1.1|) as the solution orthogonal 
to N(A). Then the normal solution is unique and has the property that its norm is 
minimal: mm||u|| = ||wo|l, where the minimum is taken over the set of all solutions 
to equation (|l.ll) . The normal solution to the equation Au — f can be defined 
as the least squares solution: \\Au — /|| = min.,u _L N{A). This solution exists, 
is unique and depends continuously on /, if _ff is finite-dimensional. The normal 
solution is also called minimal-norm solution. 

A is called closed if {m„ — > w, Aun — > /} implies {u e D{A) and Au = /}. 
By Banach theorem, if A is a linear closed operator defined on all of X then A is 
bounded. A is called compact if it maps bounded sets into pre-compact sets. The 
set {/} is bounded means there exists p > such that ||/|| < p and a set is pre- 
compact if any subsequence from the set contains a convergent subsequence. In 
a finite-dimensional Banach space a set is pre-compact iff it is bounded. If A is 
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1. WHAT ARE ILL-POSED PROBLEMS? 



an injective linear compact operator on an infinite dimensional space then A^^ is 
unbounded. 

Singular Value Decomposition: Suppose A is a compact linear operator on _ff , 
then A* is compact and \ A\ :— [A*A]'^/^ is self-adjoint, compact and non-negative 
definite, \A\(t)j — Xj4)j, Ai > A2 > ... > — > are the eigenvalues of \A\ with s-values 
of A: Sj = Sj{A) := Xj{\A\) and (pj are the normalized eigenvectors of \A\. The 
faster the s-values go to zero the more ill-posed problem is. Any bounded linear 
operator A admits the polar representation A := U\A\, where U is an isometry from 
R{A*) onto RiA), \\Uf\\ = \\fl\\U\\ = 1. One has \A\ = E^li then the 

SVD of A is A = U\A\ = ^jOV-j, where := U(j)j. 

A closed set iiT of X is called a compactum if any infinite sequence of its elements 
contains a convergent subsequence. A sequence u„ in U converges weakly to u in C/ 
iff lim„_>.co(u„, 0) = (u, 0) for all (pG H. We denote the weak convergence by w„ ^ 
u. If Un u then < liminf„_5.oo ||'i*n||- If w„ ^ u and yl is a bounded linear 
operator, then Aun An. A bounded set in a Hilbert space contains a weakly 
convergent subsequence. A functional : t/ — ^ K is called convex if the domain of 
F is a linear set and for aU u,v e D{F), F{Xu + (1 - \)v) < XF{u) + (1 - X)F{v), 
< A < 1. 

A functional F{u) is called weakly lower semicontinuous from below in a Hilbert 
space if w„ ^ M implies F{u) < liminf„_j.oo ). A functional F : U ^ R is 
strictly convex if F^-^^) < for aU ui,U2 G D{F), provided ui ^ Xu2, 

X =constant. 

Let F : AT — > y be a functional. Suppose F'{u)ri ~ lime-»+o -^'^"+^''^)~-^(") ^ 
exists for all ry, and F'{u) is a linear bounded operator in H . Then F'(u) is called 
Gateaux derivative. It is called Frechet derivative if the limit is attained uniformly 
with respect to r] running through the unit sphere. 

Spectral Theory: Let A be a self-adjoint operator in a Hilbert space H. To 
A there corresponds a family Ex of ortho-projection operators such that (t){A) :— 

mdEx; mf := mdExf; D{ct>{A)) = {/ : ||</.(A)/f = /^^ \m?{dExf, f) < 
00}; =supJ0(A)|. 

In particular A = /_°°^ XdEx and D{A) = {/ : \\Afp = J^, \X\^idExf,f) < 
00}. E\ is called the resolution of the identity corresponding to the self-adjoint op- 
erator A. X is taken over the spectrum of A. We have p{X) = {E\f, /); {dE\f, f) — 

diExf, f) - dp{X)- I ^ Coo dEx; f = dExf; Wf^ - J^" d{Exf, /); E+o, ^ 
I', E-ao — 0; -Ea-o — Ex. 

Let the operator equation Au — f he solvable (possibly non- uniquely) . Let y 
be its minimal- norm solution, y _L N{A). Let B ~ A*A > and q := A* f. Then 
Bu = q. Also, 

{B + ay' := {B + aiy is a positive definite operator and is given by 
\\{B + a) i|| = supo<A<|tBl| IaT^I < > 0. 

\\[{A+a)-^A-I]fr = a^\\{A+a)-^fr - J^" < /o^" '^(^^a/,/) = 

ll/f <oo. 

2 

If a — ?> 0, the integrand ^-^"^^2 tends to zero. So, by the Lebesgue domi- 
nated convergence theorem \\[{A + a^^A — as (5 — ^ 0, provided that 
J°\{Exf,f) = 0, i.e.,f±N{A). 
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Lemma 1. If the equation Au = f is solvable then it is equivalent to the equation 
Bu = q. 

Proof: {^)Au = f, so A*Au = A*f. 

{<^)A*Au = A* Ay, so A*A{u - y) = 0, hence A{u - y) = and hence Au = 
Ay — f. Thus we have proved the lemma. □ 

The mapping : / — > uq is called the pseudo-inverse of A. A'^ is a bounded 
linear operator iff it is normally solvable and R{A) is closed. So equation (jl.ip is 
ill-posed iff is unbounded. One can find the details of this in 5 . 

An operator $(t,u) is locally Lipschitz with respect to w G i? in the sense 
sup\\^{t,u) — $(t,v)|| < c\\u — v\\,c = c{R,uq,T) > where the supremum is 
taken for all u,v £ B{uo, R), and t S [0, T]. 
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1. WHAT ARE ILL-POSED PROBLEMS? 



2. Examples of ill-posed problems 

Example 1. Stable numerical differentiation of noisy data 

The problem of numerical differentiation is ill-posed in the sense that small 
perturbations of the function to be differentiated may lead to large errors in its 
derivative. Let / € C^[0, 1], with noisy data {5, /^j, where (5 > is the noise level, 
that is we have the estimate 

(2.1) 11/5 - /II < 'J. 

The problem is to estimate stably the derivative / , i.e., to find such an operation 

Rs such that the error estimate 

\\Rsfs-f'\\ < ry(<5) — > as ,5 0. 

This problem is equivalent to stably solving the equation 

(2.2) Au:^ ( u{t)dt^f{x), A : H -.^ L^[0,1] — > L^[0,1]; /(O) = 0, 

if noisy data fs are given in place of /. In this case, finding / — A^^f, given 
the data fs is an ill-posed problem, since equation (j2.2p may have no solution in 
L^[0, 1] if fs G I/^[0, 1] is arbitrary, subject to only the restriction \\fs — f\\ < 6, and 
if fs G C'^lO, 1] then fg may differ from / as much as one wishes however small 
S is. Also, if A is a linear compact operator then A^^, if it exists is unbounded 
and hence equation (|2.2p is ill-posed. The problem is: given {S, A, fs}, find a stable 
approximation us to the solution u{x) = f (x) of the equation (j2.2|) in the sense 
the error estimate 

(2.3) \\us-u\\<T]{5) — ^0 as S — ^ 0. 

For this we try to construct an operator Ra : H — > H such that 

(2.4) us := Ro,{5)fs 

satisfies the error estimate (|2.3p . Ra depends on a parameter a and is called a reg- 
ularizer if Ra is applicable to any fs&Y and if there is a choice of the regularizing 
parameter a= a{5) — ^ as (5 — > such that 
Rsfs Ra{S)fs — > u as 5 — > 0. 

Example 2. The Cauchy problem for the Laplace equation 
We consider the classical problem posed by J.Hadamard. It is required to find 
the solution u{x, y) of the Laplace equation 

(2.5) Uxx + Uyy^Q 

in the domain Vl — {{x,y) ^ R^ : y > 0} satisfying the boundary conditions 

(2.6) u{x,Q) — 0, Uy(x, 0) — 4'{x) — ^„sinnx; An — > as n — > oo. 

The Cauchy problem consists of finding a solution of the equation (|2.5|) satisfying 
the conditions (|2.6p . The data differ from zero as little in the sup- norm as can be 
wished, if n is sufRciently large. Its solution is given by 

(2.7) u{x, y) = sin {nx) sinh {ny), 

which, if An = 1/n, is very large for any value oiy > 0, because sinh (ny) — 0(6"^). 
As n — > oo, the Cauchy data tend to zero in C"'^(M), and m = is a solution to 
equation (|2.5p with u — Uy — ^ at y — 0. Thus, even though the solution to the 
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Cauchy problem (|2.5|) - ()2.6p is unique, continuous dependence of the solution on the 
data in the sup-norm docs not hold. This shows that the Cauchy problem for the 
Laplace equation (j2.5p is an ill-posed problem. 



Example 3. Fredholm integral equations of the first kind 

Consider the problem of finding the solution to the integral equation 

(2.8) Au{x)= ( K{x,y)u{y)dy = fix), 0<x<l 

Jo 

where the operator A : H := _L^(0, 1) — > L^{0,1) is compact and > almost 
everywhere, with kernel K{x, y) satisfying the condition: 

(2.9) I [ \K {x, y)\^ dxdy <oo. 

Jo Jo 

Then A : H — > H is compact. A compact operator in an infinite-dimensional 
space cannot have a bounded inverse. That is the problem (12. 8p is ill-posed. 
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1. WHAT ARE ILL-POSED PROBLEMS? 



3. Regularizing family 

Consider the operator equation given by with, the following assumptions: 

(1) A is not continuously invertible. 

(2) For exact values of / and A, there exists a solution u of equation (|l.ip . 

(3) A is known exactly, and instead of /, we are given its approximation 
fs &Y such that the estimate (|2.ip is satisfied in Y. 

where 5 > is a numeric parameter characterizing the errors of input data fs- 

We need a numerical algorithm for solving the operator equation satisfying 
the condition that the smaller the value of S , the closer the approximation to u 
is obtained, i.e., the error estimate (j2.3p is satisfied. The Regularizing Algorithm 
(RA) is the operator : Y — > X which, for a suitable choice of a = a{5), puts 
into correspondence to any pair {5,fs}, the element ug ^ X such that the error 
estimate ()2.3p is satisfied where us :— Ra{5)fs- For a given set of data, us is the 
approximate solution of the problem. Based on the existence and construction of 
RA, all ill-posed problems may be classified into regularizable (i.e., the ones for 
which a RA exists) and non-regularizable, and solving an ill-posed problem means 
constructing RA for such a problem. 

Let Au = /, where A : X — > y is a linear injective operator, R{A) ^ RiA), f G 
R{A) is not known and the data are the elements fs such that the estimate (|2.ip 
is satisfied. The objective is to find stable approximation us to the solution u 
such that the error estimate (12. 3p is satisfied. Such a sequence us is called a stable 
solution to the equation p.ip with the perturbed (or noisy) data. 

Let the operator equation Au = /, be given, and fs, \\fs — f\\ < 5, the noisy 
data be given in place of /. Let A be injective. Then Ra is called a regularizer of 
the operator equation if D{Ra) — H and there exists a{S) — >■ 0, 5 — >■ such that 
||-Ra(<5)/<5 — m|1 -> as (5 ^ for aU u e H. 

Lemma 2. // there exists an operator Ra, D{Ra) — H, \\Ra\\ < a{a), such 
that \\RaAu — u\\ :— 77(a) — > as a — > 0, and the function g{a) :— — ^\ is 
monotone for a G (0,Q!o), ap > a small number with g{+0) = 0, then there exists 
an a= a{S) ^ as S such that \\Ra{S)f5 — u|| —> as 5 for all u G H . 

Proof: Consider, \\Rafs ~ u\\ < \\RMs - f)\\ + Pa/ - "II < ^a(«) + '?(«) 
and a{S) can be chosen suitably. One can choose a{S) so that the minimization 
problem 

Sa{a) + ri{a) = min. — > as a — > 0. (*) 

Equation, Sa (a) +77 (a) — 0. (**) is a necessary condition for min. in (*). 
Since problem (jl.ip is ill-posed, one has a(a) — ?> 00 as a — >■ 0. The function a{a) can 
be assumed monotone decreasing and ri{a) can be assumed monotone increasing 
on (0,Q!o), r]{0) = 0. We assume in lemma, 77(a) — >• 0, as a [r]{a) > 0, 

,a (a) < 0, 77 (a) > 0,a> 0]. Since g{a) — \ is a monotone function for 
a G (0,ao), equation (*) has a unique solution a = Oi{5) for any sufficiently small 
5> 0. 

More precisely for any fixed fs, an operator Rs : H — > H such that Rs := 
Ra(S).S7 which depends on (5 is a regularizer for equation (|l.ip . if for some choice of 
a, a = a{S), one has, 

(3.1) \\Rsf5-A-'f\\^0 as S^O, for all f e RiA). 
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SO that u is stably approximated. □ 

If such a family Rs is known then the function 

(3.2) us Rsfs, 

satisfies the error estimate (|2.3p in view of (|3.1I) . i.e., formula (|3.2p gives a stable 
approximation to the solution u of equation (ll.ip . The scalar parameter a is called 
the regularization parameter. 

A construction of a family Ra^s of operators such that there exists a unique a{S) 
satisfying (|3.ip is always used for solving an ill-posed problem (|l.ip . The operator 
is said to be regularizable, if there exists a regularizer Rs which approximates 
in the sense of (|3.ip using the noisy data {(5, /a}. In the case of well-posed 
problems, is always regularizable: one may take Rs = for all S. This can 
happen only for well-posed problem. If the problem is ill-posed then there does not 
exist a regularizer independent of the noise S. 

Example: In the stable numerical differentiation example, we shall take 



(3.3) Au{x) = / uis)ds = f{x), 0<x<l. 

Jo 

Suppose fsix) is given in place of /: 

(3.4) ||./-/5|1loo(o.i) <'^- 

Following A.G.Ramm jl7j . we choose a regularizer Rs of the form: 

Rf fs{x + h{S))-fs{x-h{S)) [25 

(3.5) us = Rsfs ^ , h{S) = Y 




We note that A.G.Ramm [3j has given a new notion of regularizer. 
to [3] a family of operators R{6) is a regularizer if 
sup\\R{S)fs-v\\<r]{5) — ^0 as S — ^ 0, 

where the supremum is taken over all v G Ss — {v : \\Av — fs\\ < S,v G K}, and 
K is a compactum in X to which the solution u belongs. The difference between 
Ramm's definition and the original definition is that in the original definition u 
is fixed, one does not know the solution u e K, the only information available is 
a family fs and some apriori information about the solution u, while in the new 
definition v is any element of Ss and the supremum, over all such v, of the norm 
above must go to zero as S goes to zero. This definition is more natural in the 
sense that not only the solution u to (|l.ip satisfies the estimate fs\\ < but 

many v € K satisfy such an inequality \\Av — fs\\ < d,v € K , and the data fs may 
correspond, to any v G Ss, and not only to the solution of problem p.ip . 



CHAPTER 2 



Review of the methods for solving ill-posed 

problems 

In this chapter, we shall discuss four different methods, (variational regulariza- 
tion method, quasi-solutions method, iterative regularization method and dynam- 
ical systems method) for constructing regularizing families for ill-posed problems 
with bounded operators. See also A.G.RammfT for ill-posed problems with 
unbounded operators. 

1. Variational regularization method 

This method consists of solving a variational problem, which was proposed 
by D.Phillips (1962) and studied by A.N.Tikhonov (1963) et al by constructing 
regularizers for solving ill-posed problems. 

Consider equation (|l.ip . which has to be solved, where A : X — > Y is assumed 
to be a bounded, linear, injective operator, with not continuous, / S R{A) is 
not known, and the data are the elements {5, A, fs}, where the noise level (5 > is 
given, estimate (|2.ip holds, and the noisy data fs is the (5~ approximation of /. The 
problem is: given {S, A, fs}, find the stable solution us such that the error estimate 
(1231) holds. 

Let equation (jl.ip have a minimal- norm solution y. Variational regularization 
method consists of solving the variational problem (minimization problem) and 
constructing a stable approximation to solution y with minimal-norm such that 
yJ-N{A). Assume without loss of generality < 1, and then ||A*|| < 1. Let 
B := A* A, then B > and is a bounded, self-adjoint operator. The equation 
Au = / is equivalent to the equation Bu = q, where q := A* f. Assume that qs is 
given in place of g, - qs\\ < \\A*\\S < S. Since N{A) = N{B), y _L N{B) and 

Consider the problem of finding the minimum of the functional 
(1.1) F{u) := \\Au - fsf + a\\uf = min. 

where a > is the regularization parameter. The functional F{u) is a function of 
two parameters a and 5. Solutions of variational problem (jl.ip are called minimiz- 
ers. First, we shall prove the following two lemmas. 

Lemma 3. Existence of minimizers: For arbitrary a>0 and S>0, there exists 
a solution Ua,s to variational problem il.l]) . in the sense F{ua^s) < F(u) for all 
u&X. ' 

Lemma 4. Uniqueness of minimizers: The solution Ua^s of variational problem 
U.l]) is unique. 
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2. REVIEW OF THE METHODS FOR SOLVING ILL-POSED PROBLEMS 



Proof of Lemma O Define 
TO iniueH F{u). Note that to = ■m{6) > 0, and m < F{u), u ^ H. 
Let {un} G D{F) be a minimizing sequence for the functional F, such that 

(1.2) TO < F{un) < m + e„. e„ — >■ as n — > oo. 

So, a||u„f < TO + e„. Hence ||u„||' < 

Since a bounded set in H contains a weakly convergent subsequence, there exists 
a weakly convergent subsequence of {un}, denoted again by with m„ ^ u. 

This implies by continuity of A, Aun Au. Thus, 

< liminf„^oo ||Mn|| and \\Au- fs\\^ < liminf„^oo \\Aun - fs\\'^. 

So from equation (jl.2[) we obtain 
TO < \\Au - fsW'^ + a\\u\f < liminf„^oo(||^w„ - fs\f + \\un\\'^) < liminf„^oo F{un) 
< lim„^oo(TO + e„) = TO. 

So we have to < F{u) < m. Hence F{u) =111. So u is the minimizer of F{u). 
Thus we have proved the existence of the minimizer for the variational problem 
(HU). □ 

Proof of Lemma^ Since u is the minimizer of variational problem it 
follows that F{u) < F{u + eri), for any rj E H, and for any e g (0,eo)- So, 

Assuming that F (u) exists, this implies that {F (u), 77) > for all rj E H and 
hence F (u) = 0. We shall calculate the derivative of (ll.ip with respect to e at 
e = and get: 

iF{u + er,)U^o = [f + A«/ - fs\f + a\\u + e7j\\%=o- 
Since 

[£\\u + er]\\%=o = [fju + eT],u + eT])]\,=o = [{ri ,u + eij) , {u + eri , r])]U=Q = 
{r],u) + {u,r]) = 2i?e(w, 77) 
and 

[fJ\Au + Aerj- fs\\%=o = [£{Au + eAi^- fs, Au + eA7^-fs)]\e^o = (At^M- 
fs) + {Au - fs, Arj) = 2ReiA*Au - A*fs, 77). 
So, 

£f{u + e77)|,=o = 2ReiA*Au ~ A* fs + au, 77) = 
for all r] E H. Hence we obtain, 

(1.3) A*Au + au = A*fs. 

Thus if u is a minimizer of F{u), then equation ()1.3p holds. We claim that equation 
(II. 3p has not more than one solution. For this, it is sufficient to prove that A* Aw + 
aw — implies w — Q. Suppose that 

(1.4) A*Aw + aw = (}, a=constant > 0. 
then = {{A*A + a)w,w) 

— {A* Aw , w) + a{w , w) = {Aw , Aw) + a{w , w) — \\Aw\\'^ +a\\w\\'^ > aHuijl^, a> 0. 

Therefore, w = 0. Hence the solution to equation ()1.3p is unique, and is given 
by the formula 

(1.5) Uc.,5:={A*A + a)-'A*fs. 

for every a > and the operator {A* A + a)^^ exists and is bounded by ||(A*A + 
a)"^|| < because A* A > 0. □ 

We shall now consider the main theorem which gives us a method for construct- 
ing a regularizing family for the ill-posed problem (|l.ll) . 
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Theorem 1. Assume that A is a linear bounded, injective operator, equation 
Au ^ f is solvable, A^^ is not continuous, and let y be the minimal-norm solution: 
Ay = f , yJ-N{A). If fg is given in place of f , \\f — fs\\ < S. Then for any a> 0, 
minimization problem il.l}) has a unique solution Ua,s given by the formula lll.5\} . 
Moreover, if a = a(6) is such that 

(1.6) a(5) — ^0 and —— — ^0 as S — ^ 0, 

a(dj 

then Us :— Ua{s),s — > y as S — > 0. 

Proof: The proofs of existence and uniqueness of the minimizers were given 
above. Let us prove the last conclusion of the theorem. Assume that condition 
(HH) holds. 

Define the regularizer (by means of formula (jl.Sp so that it satisfies equation 

my- 

(1.7) Rafs ■■= Ra{S)fs = {B + ay^A* fs, a=a{S). 

li f — Ay, then RaAy — {B + a)^^By — !• y as a — > 0. Here the assumption 
y _L N{A) is used. We claim that 

(1.8) \\Rc.fs-y\\^0 as 
Since, 

||i?a/5-y|| < \\RMs-f)\\ + \\Rc.f-y\\ <\\fs~ /||||i?a||+77(«) < i\\A*\\+r,{a) 
< - + ri{a) ^ as (5 — > 0, because of (|L6]) . □ 
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2. REVIEW OF THE METHODS FOR SOLVING ILL-POSED PROBLEMS 



2. Discrepancy principle for variational regularization method 

Assumptions (A) Let ^ be a linear, bounded, injective operator. Let equation 
Au — f he solvable. Let A^^ not be continuous and let there exist a minimal-norm 
solution y such that Ay = f, y 1. N{A). Let fs be given in place of /, ||/ — /^H < S. 
Let us be the stable solution of equation (|l.ip given by us — {B + a)^ A* fs- 

The discrepancy principle (DP) introduced by Morozov is used as an aposteriori 
choice of the regularization parameter a and this choice yields convergence of the 
variational regularization method. Choose the regularization parameter a—a{S) as 
the root of the equation 

\\^Ua,s - fs\\ = CS, C = constant > 1. (*) 
The above equation, is a non-linear equation with respect to a. It defines a as an 
implicit function of S. Let us assume that \\fs\\ > CS. 

Theorem 2. Suppose that the assumptions (A) above holds. Then there exists 
a unique solution a— a{d) > to equation (*) and \\ms^o a{5) — 0. Moreover, if 
Us := Ua(s).5 is given by formula jl.Tl^ , then lim5_j.o \\us — y\\ = 0. 

Proof: Denote Q AA* . Then, N{Q) = N{A*), and {B + a^'^A* =A*{Q + a)"\ 
By variational regularization method, for any a> 0, minimization problem ()l.ip 
has a unique solution Ua^s = {B + a)^ A*fs. Since, — /|| < S; f ^ Ay, so, 
/ _L N{A*). From equation (*), 

CH^ - \\Au^,s - fsr - + a)-^A* - I]fs\\^ - \\[QiQ + a)-^ - I^sf 

= a^iQ + a)-^fsr = J^" ^^^^ S) 
one has, 

lim„^oo/(a,5) = /o"^" d{ExfsJs) = \\fs\\^ > CH\ 
and 

lima->-Ho^(a,^) = II ^Ar(Q)/<5 no- 
where Pn{q) is the orthogonal projection onto the null-space of Q, 

P{a.b)fs ■= JadExfs 

and 

\\PiaMfsr--=IadiExf5j5). 

So 

\\PNiQ)f5r < '^^t+iy'^ ^ /o d{Ey.fs, fs) = ||P(0,.)MI^. 

Since 

-FW(A*)/<5 = PN{A*)ifs - f) + PN{A')f 

and since PN{A*)f = 0, one has 

\\PN(A')fs\? - \\PNiA'){fs - fW <\\h- f\? < 5\ 

Thus, 

lim„^+0/(«,^) = \\PNiQ)hr = \\PNiA')fsr <S'< CH\ 

Equation (*) is a non-linear equation of the form C^5^ — I{a,6), for a given 
fixed pair {fs, 6}, the function I{a, 6) satisfies limQ,_>.+o I{a, S) < C^6^ and lima_>.oo S) > 
C^S'^. Hence I{a,d) is a monotone increasing function of a on (0,oo). Hence, 
equation (*) has a unique solution a=a{6). Now let us prove that lim5_j.o a{5) = 0. 
Suppose that a{S) > ao > 0. So as (5— )■ 0, 

This contradicts the assumption that a{S) > 0. It remains to prove the last 
conclusion of the theorem. Define the regularizer by the formula (by means of 
formula ()1.7p ) 
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Rsfs US := Uq(5),5, 

where a{S) is given by the discrepancy principle. Let us prove that \\us — ?/|| — ?> 
as (5 — >■ 0. Since us is a minimizer of (jl.ip . we have 

Fius)<Fiu), \\Aus^fsr + amusr<S' + amyf (**) 
then from equations (*) and (**), we obtain, 

IKf <IMI^^ Ik^ll<ll2/I|. ^ 

This imphes that there exists v such that us ^ v as 5 — > and by continu- 
ity of A, Aus — !• Av. So from (**), as (5 and a it follows that Aus — > f. 
So, Av = f. Since A is injective, this implies that v ^ y. So, us ^ y as 5 — > 0. 
Also, since, \\us\\ < \\y\\, 

\\y\\ < liminf^^o \\us\\ < limsup^^o \\us\\ < \\y\\. 

Therefore, lim5_i.o \\us\\ exists and lima^o \\us\\ = \\y\\- Thus, lima_j.o \\us — y\\ ~ 0. 
Hence the theorem is proved. □ 
Note that: F{Pj^(^a)^u) < F{u). 

Proof: Let u ~ uq + ui, where uq G N{A) and ui € N{A)-^. 

An ~ Auo + Aui — Aui, since Auq = 0. 

So, \\Au- fsW" = \\Au^~ fs\\\ 
Also, a||u|p = a[||uo|P + ll^ilP] > 

This implies that, F{ui) < F{u). So F{ui) = F{Pj^^ji)±u) < F{u). Hence a 
minimizer of F is necessarily orthogonal to null-space of A. 

Remark: A.G.Ramm [7] has generalized the discrepancy principle for the cases: 
(a) when A is not injective, (b) when A is not compact and not injective and (c) 
when A^^ is not continuous. He has also shown that discrepancy principle, in 
general does not yield convergence which is uniform with respect to the data. 
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3. The method of quasi-solution 

The method of quasi-solution was given by Ivanov (1962). It is similar to the 
variational regularization method except that there is a restriction on the functional 
defined. 

Consider the operator equation which has to be solved, where A is assumed 
to be a bounded, linear injective operator on Banach spaces X and Y or B.{A) is 
assumed not to be closed, so that the problem is ill-posed. The data are the 
elements {6, A, fs}, where the noise level 5 > is given such that the estimate (12. ip 
holds, i.e., the noisy data fs is the 5— approximation of /. The problem is: given 
{6,A,fs}, find the stable solution us such that the error estimate (|2.3[) holds. Let 
equation have a solution y G K, a convex compactum (closed, pre-compact 

subset) of X. Consider the variational problem: 

(3.1) F{u) := \\Au - fs\\ — > inf., ueK. 

Definition 2. A quasi-solution of equation il.l}) on a compactum K is a 
solution to the minimization problem i3.1\) . 

Lemma 5. ; Existence of quasi-solution: 
Assume that A is a bounded linear injective operator and that equation il.l}) holds. 
As.sume that equation il.l]) has a solution y £ K a compactum of X. Then the 
minimization problem iS. 1\) has a stable solution us £ K such that \\us — y\\ — > 
as 5 — ^ 0. 

Proof: Denote 

(3.2) m{5) := inf \\Au~ fs\\. 

Since, the infimum m ~ m{5) depends on fs and since y ^ we have, 

miS) = inf„eK \\Au - fs\\<\\Ay - fs\\ = ||/ - fs\\<S. 
So m((5) — > as S — > 0. Let 7i„ be a minimizing sequence in K: 

(3.3) F{un) -.^ \\Aun - fs\\ — >m{d), m„ G if , n — ^ oo. 

So we have sup„||Aw„|| < oo. Let us now take S — > 0. Since Un (z K and K is 
a compactum, there exists a convergent subsequence in K, which we again denote 
by Un, such that 7i„ — > Uqc- Since K is a compactum, it is closed. Therefore 
the limit Uoo G K. By continuity of A, this implies that Aun — > Auoo, and 
lim„^oo \\Aun - fs\\ = \\Auoo - fsW = m{5). 
Denote 

(3.4) us -.^ Uao ^ Uao{5) e K . 

Thus, us is the solution of the minimization problem 
\\Aus- fsW^HS)- 

It remains to be shown that us E K, is the quasi-solution of equation (|l.ip . 
Now, as 5 — > 0, there exists a subsequence us^ G K which is again denoted by 
Un, such that m„ — > v € K. By continuity of A, this implies that Aun — > Av. 
Therefore, since m{6) — > as S — > 0, 

(3.5) — >0, as S — >0. 
Since, A is injective, v — y. Thus, 

(3.6) lim|lu„-y|l=0. 
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Since the limit y of any subsequence m„ is the same, the whole sequence u„ converges 
to y. Thus a quasi-solution exists. Hence lemma 5 is proved. □ 

It remains to be proved the uniqueness and its continuous dependence on / of 
the quasi-solution. 

Theorem 3. If A is linear, hounded and injective operator, K is a convex com- 
pactum and the functional F{u) in minimization problem \3. 1\) is strictly convex, 
then for any f, the quasi-solution exists, is unique, and depends on f continuously. 

Proof : 

The following lemmas, are needed for the proof of theorem (3). 

Lemma 6. Let iniu^K \\u — f\\ := dist{f,K) :— m{f). Then there exists a 
unique element u = u{f) := Pk f G K called the metric projection of f onto K 
such that II-Pr-/ — f\\ = dist{f,K). 

Proof: Existence of Ppcf: Let u„ be a minimizing sequence in K, ||Mri — /|| — > 
m(f), Let n — > oo. Then there exists a convergent subsequence in K, which we 
again denote by u„, such that u„ — > u G K. Thus, \\u — f\\ — m{f). So u = Pxf- 

Uniqueness of PKf- Suppose there exists u, v which are distinct metric projec- 
tions. Then m(/) = — /|j = — /|| < — /|| for all w G K. Since A' is convex, 

€ K. This implies that 

<\m^-f\\^ ll^^^^ll < + = m(/). 

So, 

\\li±-^f\\^mif). 
Thus. 

h-./ll = l|f-/ll = ll^^^^ll- 

Since X is strictly convex, it follows that {u— f) = X{v — /). Since \\u — f\\ ~ 
\\v — /II, A = +1,-1. If A = 1, then u — v which is a contradiction. If A = — 1, 
then / = -^^Y^- Since K is convex, this implies that f E K, this gives that Pfcf — f 
which is a contradiction. Thus Pj^ is a bijective mapping onto K. Hence Lemma 6 
is proved. □ 

Lemma 7. dist{f, K) is a continuous function of f. 

Proof: Let dist{f,K) :~ m{f). Suppose f ~> g. Then to prove that m(/) — > 
m{g). Let u{f) — PKf G K and u{g) — Pxg G K- (/ and g are arbitrary they 
need not be in K). 
So 

ll"(/) - ./II = infueKWu - /II and \\u{g) - g\\ = infueK\\u - g\\. 
So, 

™(/) = \Hf) - /II < Mg) - /II < \\u{g) - g\\ + \\g - f\\. 

Hence, m(/) - m{g) < ||g - /|| . 
Similarly, 

m{g)-m{f) < ||5-/ll- 
Thus, 

\m{f)-m{g)\ < ||/-ff||. 
Hence lemma 7 is proved. □ 

Lemma 8. PKf is a continuous function of f (in a strictly convex Banach 
space). 
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Proof: Suppose there is a sequence fn ^ g- Then to prove that 
||u(/„) - as n^oo. (*) 

Suppose (*) is not true, so that there is a sequence u„ in K which does not 
satisfy (*). Since K is a compactum, there exists a subsequence Unk G K oi Un, 
which is denoted again by u„ such that, 
\\un-uig)\\ > e > 0. 

Also, since K is closed, u„ — > u e i^, so that 

\\v ~ u{g)\\ > e>0. (**) 
\\u{g)-g\\<\\v^g\\. {***) 
Now, 

\\v - g\\ < \\v - Un\\ + \\Un - ,fn\\ + \\.fn - g\\- 

By lemma 7, since /„ g, ||u„ - /„|| = m(/„) m{g). 
Also we have, 
\\v - u.a\\ and ||/„ - g\\ 0. 
Thus, 

\\v~9\\<m{g) = \\u[g)~g\\. (****) 
So, by inequalities (***) and (****), 
\\u{g)-g\\ = \\v-g\\. 

This by uniqueness implies that v = u{g). This contradicts inequality (**). Hence 
lemma 8 is proved. □ 

Lemma 9. If A is a closed (possibly non-linear) injective map over a compactum 
K <Z X onto AK , then A~^ is a continuous map of AK onto K. 

Proof: Let /„ = Aum where the sequences m„ S K, and /„ G AK. Assume 
that fn^f- Then to prove that / G AK, that is to prove that there exists a u e if 
such that Un — A^^fn — !■ u = A^^f. Since X is a compactum, and since u„ G K, 
there exists a convergent subsequence, which is again denoted by u„ € such that 
Un — > u. Since if is a compactum, it is closed, so u £ K . Because any convergent 
subsequence of u„ converges to a unique limit u, implies that the whole sequence 
converges to u. Since u„ u, fn = Aun — >■ / and A is closed, therefore, Au — f. 
Since A is injective, this implies that u = A~^ f. Hence lemma 9 is proved. □ 

Proof of continuous dependence on f in theorem (3): 

Existence of quasi-solution is proved in lemma (5). Since K is convex and A 
is linear, so AK is convex. Since AK is convex and F is strictly convex, by lemma 
(6), PAxf exists and is unique. By lemma (8), PAKf depends on / continuously. 
Let Au — PAKf- Since A is injective u = A~^PAKf is uniquely defined and by 
lemma (9), depends continuously on /. Thus theorem (3) is proved. □ 

Remark: 

By theorem (3), if if is a convex compactum of X which contains the solution 
u to equation if A is an injective linear bounded operator, and F is strictly 

convex, then us — A~^ Pak fs satisfies \\us — u|| as (5 — ?> 0. The function 
Ufi can be found as the unique solution to the minimization problem p.ip with fs 
in place of /. Further instead of assuming operator A to be bounded, A can be 
assumed to be closed, since a bounded operator defined everywhere is closed. 
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4. Iterative regularization method 

Consider the operator equation which has to be solved, where A : H — > H 
is assumed to be a bounded, Unear injective operator on a Hilbert space H with 

unbounded. So the problem is ill-posed. The data are the elements {5, A, fs}, 
where the noise level (5 > is given such that estimate (|2.1|) holds, i.e., fs is the 
(5— approximation of /, where / E R{A). Let Au — f he solvable and let y be its 
minimal-norm solution. The problem is: given {d,A,fs}, find the stable solution 
Us such that error estimate (|2.3I) holds. Let 

(4.1) Bu = q:=A*f, where B = A*A>0. 

Let qs be given in place of q. Since Au — f is solvable, it is equivalent to Bu = q. 
Since A is injective, B is also injective. Assume without loss of generality ||A|| < 1, 
which implies that \\A*\\ < 1. Since |1/ - fs\\ < S we obtain, \\q - qs\\ < \\A*\\S, 
hence we obtain 

(4.2) \\q~q5\\<5. 
Consider the iterative process: 

(4.3) Un+i=Un- fi{Bun-q), 0</i<-4t7, u{0) ^ uo ± N{A). 

For example one may take uq = 0. We obtain the following result: 

Lemma 10. Assume that equation U.l]) is solvable, and that y is its minimal- 
norm solution. Then 

(4.4) limn^ooUn = y- 
Proof 

We note that from equation (|4.3p . 

(4.5) y = y - ^i{By~ q). 

Denote u„ — y := 7„. Subtracting equation (14.51) from equation (j4.3p and using 

induction, 

we obtain 

In+l = In - fJ.Bjn = (^ " M-S)7n = ■•■ = {I - fJ.B)''+^J„ 

with 70 = uo - y, 70 -L N{A). Since, < (1 - ^iA) < 1, for ah Ae (0, ||B||), 
we have, 

hniP = 11 - MAp"d(i?A7o, 70) = + /j"'" := h + h. 

If e<A<||B|| then 1 - ^A < 1 - < 1. Denote 
p := 1 — lit, < p < 1. 
Then 

h < P^" — > 0, n — > 00. 
So 

I2 — > 0, n — > 00. 
Since 1 — /lA < 1, 

h < /;d(SA7o,7o) ^0, e^O. 

Since 70 -L N{B) = N{A), ||7„|| — ^ 0, as n — > 00. Hence (gH) holds. □ 
Now, we shall prove the main theorem. 

Theorem 4. Suppose that A is a linear, bounded, injective operator on a Hilbert 
space with A^^ unbounded satisfying the equation Au = f. If qs is given such that 
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Wqs — q\\ < 6, then one can use the iterative process |^.,$[ ) with qs in place of q for 
constructing a stable approximation of the solution y. 

Proof: By the iterative process, (|4.3p 

(4.6) Un+i,s = Un,s - ti{Bun^s - qs), u(0) = Mo. 
From equation (|4.5p one has: 

y = y- KBy - q). 

Denote Un,s - y ■= Jnj- 

Then subtracting equation (|4.5p from equation (I4.6p . 

(4.7) 7«+i.5 = 7n,5 - A*-B7n,5 + - g), jo = uo-y. 

So that by induction, 

In.s = {I - M^)"7o + EjCo il^BYMls ~q), 70 = Wo - y- 
Thus, 

ri-l 

(4.8) 7„,5 = 7« + ^ {fiBYfiiqs - q), Jo = Uq - y. 

3=0 

Since, < 1 and by using (|4.2I) . we obtain, 

||7n,5|| < Il7n|| + nfiS, n>l 

It is aheady proved in lemma (fTO|) . that ||7„|| — > Q as n — > oo. Hence 
Il7ri,i5|l — > as S — > 0. Thus theorem|4]is proved. □ 

Remark: In this method the regularization parameter is the stopping rule, n{6), 
the number of iterations and can be found by solving the minimization problem 

Il7(n)ll + '^/-'^ = min. — > as S — > 0, n > 1 and n{5) — > od as S — > 0. 
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5. Dynamical systems method 

In this section we study dynamical systems method for solving linear and non- 
linear ill-posed problems in a real Hilbert space H. The DSM for solving operator 
equations consists of a construction of a Cauchy problem, which has a unique global 
solution for an arbitrary initial data, this solution tends to a limit as time tends to 
infinity, and this limit is the stable solution of the given operator equation. This 
method can be used for solving well-posed problems also. Our discussion is based 
on the paper by A.G.Ramm [2 . 

Consider an operator equation 

(5.1) F{u):^Bu^f^O, feH 

where i? is a linear or non-linear operator in a real Hilbert space H. We make the 
following assumptions. 

Assumption 1 Assume that F has two Frechet Ua.s derivatives: F g Cfoc^ i-^-j 

(5.2) sup ||F(^')(^^)|| < Af,(i?), J =0,1, 2 

ui£B{ua,R) 

where B{uq,R) := {u : ||u — mqH < R}, uq is arbitrary fixed element in H and 
i? > is arbitrary and F^^\u) is the j-th Frechet derivative of F{u). 

Assumption 2 Assume that there exists a solution y G B{uo, R) (not necessarily 
unique globally) to equation ()5.1|) : 

(5.3) F{y) = 

Problem (|5.ip is called well-posed if F'{u) is a bounded invertible linear oper- 
ator, i.e., if [F'{u)]^'^ exists and if the estimate 

(5.4) sup \\[F'{u)f\\<m{R), 

u£B{uo,R) 

Otherwise, it is called ill-posed. 

Let ii denote time-derivative. Consider the Cauchy problem (dynamical sys- 
tem): 

(5.5) -u = #(^, u); m(0) = uo 

where # is a non-linear operator, which is locally Lipschitz with respect to u G iJ 
and continuous with respect to t > 0, so that the Cauchy problem (15. 5p has a 
unique local solution. The operator # is chosen such that the following properties 
hold: 

(1) There exists unique global solution u{t) to the Cauchy problem (|5.5|) . 
(Here global solution means the solution defined for all t > 0. ) 

(2) There exists u{oo) := WuYt^ao u{t). 

(3) and finally this limit solves equation (|5.ip : F{u{oo)) = 0. 

Problem (|5.ip with noisy data fs, \\fs — /|| < 5, given in place of /, generates the 
problem: 

(5.6) iis = ^s{t,us), us{0) = uq, 

The solution us to problem (|5.6|) . calculated at t = ts, where tg is suitably chosen, 
satisfies the error estimate 



(5.7) 



^mjusits) - y\\ = 0. 
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The choice of tg with this property is called the stopping rule and is the regular- 
ization parameter in DSM method. One has usually lim5_>o ts ^ oo. 

Dynamical systems method can be used to solve ill-posed and also well-posed 
problems. In this report we are interested in discussing solving linear ill-posed 
problems by DSM. One can also find in A.G.Ramm's paper [2 , a discussion of 
DSM for solving well-posed problems, nonlinear ill-posed problems with monotone 
and non-monotone operators and the recent development of the theory of DSM. 



CHAPTER 3 



Dynamical systems method for linear problems 

In this section, for linear solvable ill-posed problem Au = /, with bounded 
linear operator < 1, DSM is justified and a stable approximation of the minimal 
norm solution to ill-posed problem with noisy data fg, — / || < ^ is constructed. 
This section is based on paper [2\. 

Assume that (2.24) and (2.25) holds and (2.26) fails so the problem is ill-posed. 
Consider the equation 

(0.8) Au^f 

where / G R{A) is arbitrary. Let us assume the following 
Assumptions {*) . 

(1) Let A be a linear, bounded operator in a Hilbert space H, defined on all 
of H, the range R{A) is not closed, so that A~^ is unbounded. So problem 
(10.81) is an ill-posed problem. Let fs be given in place of /, ||/ — fs\\ < S. 

(2) Equation (jO.Sp is solvable (possibly non- uniquely) . Let y be the minimal- 
norm solution to equation (10. 8p . y _L N{A), where N{A) := {v : Av = 0} 
is the null-space of A. 

Let B = A* A > and q := A* f, A* is the adjoint of A. Then we obtain the normal 
equation, 

(0.9) Bu = q. 

We know that if equation (|0.8p is solvable then it is equivalent to equation (|0.9|) with 
qs given in place of g. Without loss of generality assume ||A|| < 1, so ||A*|| < 1 and 
||B|| < 1. Then \\q-qs\\ = \\A*{f-fs)\\ < \\A*\\d < S and y _L 7V(B). Let e{t) > 0, 
be a continuous, monotonically decaying function decaying to zero function on R+ 
such that Jp eds = 00. Let 

(0.10) F{u) -.^ Bu- q^O 

then F (u) — B. Consider the Cauchy problem 

(0.11) M=*(t,M), M(0)==lio. 

*(t, u) := -[F'{u) + e{t)]-^[F{u) + e{t)u] ^ -[B + e{t)]-^[Bu -q + e{t)u]. 

Thus from the Cauchy problem (jO.lip . the DSM for solving equation (|0.10p is 
solving the Cauchy problem 

(0.12) u^^{t,u) = -u+[B + e{t)]-^q, u{0) = uq. 

with 

(0.13) = -us + [B + eit)r\s. 
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We now prove the main theorem of this section: Given noisy data fs, every 
linear ill-posed problem W. ^|) under the assumptions (*) can be stably solved by the 
DSM. 

Theorem 5. Assume (*), and let B A* A, q :— A*f. Assume e{t) > 
to be a continuous, monotonically decaying to zero function on [0, oo) such that 
Jg eds = oo. Then we have the following results. 

(1) For any uq £ H, the Cauchy problem i0.12\) has a unique global solution 
u(t), (the initial approximation uq need not be close to the solution u{t) 
in any sense). 

(2) There exists hmt_>.oo u(t) = u{oo) — y, and y is the unique minimal- 
norm solution to equation i fO.<$|) . Ay — f,y J- N , and \\y\\ < \\z\\, for all 
ze N ■.= {z: F{z) ^ 0}. 

(3) If fs is given in place of f, \\f — fsW < S, then there exists a unique global 
solution us{t) to the Cauchy problem 

(0.14) us = ^sit,us) = -us-\-[B + e{t)]-\s, us{0) ^ uq 

with qs -.^ A*fs. 

(4) There exists ts, such that it satisfies the error estimate 

(0.15) hm ||u5(i5) — y\\ = 0, hmt^ = oo. 

The choice of ts with this property is the stopping rule. This ts can be for 
example chosen by a discrepancy principle or as a root of the equation 

(0.16) 2Ve(^) = <5^ 6g(0,1). 

Proof: Sinee the Cauchy problem (jO.lip is hnear, its solution can be written 
by an explicit analytic formula 

(0.17) u{t) = Uoe-^+[ e-^^-'''>[B + e{s)]-^Byds. 

Jo 

Taking limit as i — >■ oo to (|0.17|) and applying L'Hospital's rule, to the second 
term in the right hand side of equation ()0.17|) . we obtain, 

hm,^^ f^^'lB+.is)r^Byds ^ + e{t)]-^By, 

provided only that e{t) > and limt_j.oo e(0 — 0. 
Since y ± N = N{B) = N{A), 

(0.18) lim [B + e]-'By = lim /" " -^dE^y - /" " dExy = y, 

by the spectral theorem and by the Lebesgue dominated convergence theorem, 
where E\ is the resolution of the identity corresponding to the self-adjoint operator 
B, X is taken over the spectrum of B, and lim£_j.oj^ = 1, for A > and = 0, for 
A = 0. Thus from equations (|0.17p and (|0.18l) there exists u(oo) = limt_j.oo u{t) — y 
with Ay = f. 

Denote r]{t) \\u{t) — y\\, then limt_j.oo ?y(i) — 0. In general, the rate of 
convergence of rj to zero can be arbitrarily slow for a suitably chosen /. Under 
an additional a priori assumption of / (for example, the source type assumptions), 
this rate can be estimated. 

Proof of results 3 and 4- Derivation of the stopping rule. 

Consider the Cauchy problem with noisy data. Suppose fs is given, with \\fs — 
/II < S, then \\qs — q\\ < S. We require the following lemma for the proof: 
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Lemma 11. 

(0.19) i|[B + ,]-iA*||<^ 

Proof of lemma: We have B := A* A > 0. Denote Q := AA* > 0, then ||g|| < 1. 
We have 

[B + eI]-^A* = A*[Q + eI]-\ 
So, 

\\[B + eI]-^A*\\ = \\A*[Q + eI]-^ = ||C/Q1/2[q + 

(U being the isometry operator (II J7/II = ||/||), and A = U\A\ = U{A* A)^/'^ , polar 
representation of the Unear operator). 

= ||Qi/2[Q + eJ]-i, (since \\U\\ = 1.) = || J,' ^dE,\\ = supo<,<i ^ = 
(by the spectral theorem: (j){A) — (j){X)dE\, ||0(A)|| = sup;^ |</>(A)|, A is 
taken over the spectrum oi A). □ 
By triangle inequaUty, 

\\usit)-y\\ = \\usit)-u{t) + uit)-y\\ < \\usit) - u{t)\\ + \\u{t) ^ y\\ = \\usit) - 
u{t)\\+rj{t). 

\\us{t)-um ^ \\J^e-(^'^)[B + e{s)]-\qs-q)ds\\ < J^e~(^-^)^^, by mB 
< since e^^^-^Us = 1 - e"* < 1. 
So, 

(0.20) ||^,(t)_y(t)|| <_i_. 

Thus, \\usit)-y\\ <^^+r,{t). 

We have aheady proved that hmt_j.oo vi^) — 0- Choose, t — tg, satisfying 
equation ()0.16p then this particular choice of tg satisfies the error estimate (jO.lSp 
and ||w5(t) — u{t)\\ — > as 6 — > 0. If the decay rate of r]{t) is known, a more 
efficient stopping rule can be obtained by choosing, t = tg such that it satisfies the 
minimization problem 

2^ + i]{tg) = min. — >0 as S — ^ 0. □ 

Remarks 

Remark 1: Discrepancy principle for the DSM. 

Choose the stopping time tg as the unique solution to the equation: ||j4w5(t) — 
fg\\ = CS where C=constant> 1, where it is assumed that ||/5|| > S. In-addition, 
we assume that fg _L N{A*), so that C=l, then the equation is: 

(0.21) \\A[B + e{t)]-'A*fg- fg\\=S. 

Then this tg satisfies the error estimate (jO.lSp . One can find detailed discussion of 
this in A.G.Ramm's paper [5]. 

Remark 2: Choosing scaling parameter e{t). 

We can choose the scaling parameter as large as we wish. In particular we can 
choose 

Cl 



where, < 6 < l,ci,C2 are positive constants. 
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